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Abstract 

Information functionals allow to quantify the degree of randomness of a given proba- 
bility distribution, either absolutely (through min/max entropy principles) or relative to 
a prescribed reference one. Our primary aim is to analyze the "minimum information" 
assumption, which is a classic concept (R. Balian, 1968) in the random matrix theory. We 
put special emphasis on generic level (eigenvalue) spacing distributions and the degree of 
their randomness, or alternatively - information/organization deficit. 

PACS: 02.50,03.65,05.45 

1 Motivation 

The statistical theory of random-matrix spectra [U [2] provides an ideal playground to test 
workings of the Shannon and Kullback -Leibler entropies in diverse contexts. That pertains 
to a direct analysis of spectral data for complex quantum systems (semiclasically chaotic 
case included) , but as well to the statistics of Gaussian matrix ensembles and random matrix 
diffusion processes. Dyson's interacting Brownian motion model can be interpreted as as a 
non-equilibrium dynamical process, whose asymptotic distribution is related to the thermo- 
dynamical equilibrium state of a Coulomb gas (RMT as equilibrium statistical mechanics). 
Ultimately one may pass to probability densities inferred from the ground state(s) of singular 
Calogero-type quantum systems: Shannon and K-L entropies prove to be proper tools in the 
quantum case as well. 

Before embarking on these issues, let us indicate that there are ambiguities involved in 
the very concept of information and (un) certainty. To stay on a solid ground, [3j-[6], we 
must accept a specific lore of semantic games, where baffling synonyms quite often appear 
and their specific meaning is under scrutiny. Examples are: information vs entropy no- 
tions, (un)certainty and randomness vs information deficit, entropic measures of surprise vs 
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information functionals, min/max entropy principle vs effective randomness (uncertainty), 
uncertainty (lack of information) vs (quantum) indeterminacy. 

Since a particular definition of an entropy functional is non-unique and to high extent 
purpose-dependent [B] one must make suitable choices in the entropic menu ("entropic mess", 
with a partially random order of entries): Clausius thermodynamic entropy, Boltzmann, 
Gibbs, Shannon, relative, conditional, Kullback-Leibler, Renyi, Tsallis, Wehrl, information 
entropy, differential entropy, Kolmogorov-Sinai entropy, von Neumann entropy; the list may 
be continued. 

We shall basically invoke the Shannon and Kullback-Leibler entropies, in conjunction 
with continuous probability distributions on R + . We base our discussion on the text-book 
wisdom that the entropy is a measure of the degree of randomness and the tendency (in the 
time domain) of physical systems to become less and less organized. We extend this verbal 
phrase to probability densities of the functional form: 



with s € R + , a = 1 or 2, while /3 = 0, 1, 2, 3, 4. 

The above formula encompasses [lj a number of "quantum chaos" -related level spacing 
distributions: Poisson (strictly speaking -exponential), semi-Poissonian of various types and 
the generic family of spacing densities, that are exact for 2x2 random matrices, and are 
identifiable as n = 2,3,4,5 Bessel-Ornstein-Uhlenbeck probability laws (densities) on R + . 

The latter arise directly from Gaussian matrix ensembles and n in the exponent of s n ~ l 
counts the independent 2x2 Gaussian random matrix elements, (/? = n — 1). With the 
(s) = 1 normalization, we have: 



The (3 = 0, (s) = 1 normalized Gaussian on R + reads Po(s) = (2/V) exp(— s 2 /ir), and has 
variance ((s - (s)) 2 ) = (vr - 2)/2. 







(2) 
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2 Random variables on R + and entropic measures of proba- 
bility (de) localization 

2.1 Entropies 

Given a probability measure ^2f=\ [ij = 1. Its Shannon entropy reads S(p) = — Y2j=i Pj In pLj 
and takes a maximum value In N in the "most random" case of a uniform distribution: 
fij = 1/N for all 1 < j < N. An obvious minimum at appears if for any j we have pj = 1. 

We shall focus on continuous probability distributions on R + . The corresponding Shannon 
entropy is introduced as follows: 

p(s) ds = 1 — > S(p) = — J p(s) In p{s)dx (3) 

At this point it is instructive to mention that in the realistic (spectral data analysis) 
"quantum chaos" framework, one encounters spacing histograms and definitely not continuous 
probability densities. The latter may merely be interpreted as useful continuous approximants 
of discrete probability measures. 

The situation is more involved in case of the corresponding Shannon entropies, where the 
approximation issue is delicate. Even if one follows a pedestrian reasoning, we can justify 
and keep under control the limiting behavior, [3, [6]: 

- r 

Y^Pj = l^ pdx = l. (4) 
l J 

An immediate question is: what can be said about the mutual relationship of S(p) = 
— J2i Mj l n an d S(p) = — f p(s) In p(s)ds ? 

We first observe that < — pj In pj < In N and consider an interval of length L on 
a line with the a priori chosen partition unit As = L/N. Next, we define: pj = pjAs and 
notice that (formally, we bypass an issue of dimensional quantities) 

s (v) = - E( As )^' ln ^- - ln ( As ) ( 5 ) 

Let us fix L and allow A^ to grow, so that As decreases and the partition becomes finer. 
Then 

ln(As) < -^2(As)pjln Pj < InL (6) 



where 



S(p) + ln(As) = - Y^i As )Pj ln Pj s (p) = ~ j P( s ) lnp(s)ds (7) 



S(p) is the Shannon information entropy for the probability measure on the interval L. 
In the infinite volume L — > oo and infinitesimal grating As — ► limits, the density functional 
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S(p) may be unbounded both from below and above, even non-existent, and seems to have 
lost any computationally useful link with its coarse-grained version S(p,). 

However, the situation is not that bad, if we invoke standard methods [3], [6] to overcome a 
dimensional difficulty, inherent in the very definition of S(p), if we admit dimensional units. 
Namely, we can from the start take a (sufficiently small) partition unit As to have dimensions 
of length. We allow s to carry length dimension as well. Then, the dimensionless expression 
for the Shannon entropy of a continuous probability distribution reads: 

S A (p) = - J p(s)ln[As ■ p(s)]ds (8) 

and all of a sudden, a comparison of Eqs.(5) and (8) appears to make sense. We can legiti- 
mately set estimates for \S(p) — S A (p)\ and directly verify the approximation validity of S(p) 
in terms of S A (p), when the partition becomes finer. 

In the present paper we are interested in properties of various continuous probability 
distributions, and not their coarse-grained versions. Therefore our further discussion will 
be devoid of any dimensional or partition unit connotations. Since negative values of the 
Shannon entropy are now admitted, instead of calling it an information measure, we prefer 
to tell about a "localization measure", "measure of surprise" or "measure of information 
deficit". 

2.2 Poissonian spacing distributions 

Let Xi,X2,-.- be independent random variables on R + , with a common for all of them 
exponential probability law 

p(x) = ceexp(— ax) (9) 

a > , mean ^ variance -4. Let us denote S n = X\ + X2 + ... + X n , n = 1,2, ... and note 
that S n has the density (Poisson probability law): 

a n z n_1 

Pn(x) = 7 — exp(-ax) (10) 

(n — 1)! 

coming from an (n-l)-fold convolution of exponential probability densities on R + . The law 
is infinitely divisible: 



Pn+m{x) = (Pn * Pm){x) = \ P n {x - y)p m (y)dy (11) 

J 

with pi(x) = p(x) and n, m = 1, 2, .... 

In particular, Xi + Xj for any £ ./V has a probability density p%{x) = a 2 x exp(— ax) 
which upon setting a = 2 and x = s stands for an example of a semi-Poisson law 

P(s) = 4s exp(-2s) (12) 
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known to govern the adjacent level statistics for a subclass of pseudo-integrable systems. 
Other (plasma-model related) semi-Poisson laws arise as well. For example, S3 has a density 
Pz(x) which upon setting a = 3 and x = s, gives rise to 

27 

P(s) = —s 2 exp(-3s) . (13) 

Analogously, 5s yields p& (x) and upon setting a = 5 implies 

31 25 

P{s) = —s 4 exp(-5s) (14) 

The distribution Eq. (|10p . here identified as the Poisson probability law for the random 
variable S n , in the information-theoretic literature is known as the (a, re)-Erlang distribution. 
Its Shannon entropy reads, [3]: 

S(p n ) = In r(n) + (1 - n)i/)(n) + n - In a (15) 

where the Euler gamma function T(x) = J °° exp(— t) t x ~ l dt appears, together with the 
digamma function (logarithmic derivative of F) ip(x) = ^lnr(x). 

We have F(n) = (n — 1)! and ip(n) = H n _\ — 7, where 7 = lim n ^ 00 (^T n — Inn) ~ 
0,577215 is the Euler-Mascheroni constant, while harmonic numbers H n = Ylk=l0-/ty take 
the consecutive values 1,3/2,11/6,25/12 etc. 

Notice that a = n should be set if one needs to address the previous P (s). For the pure 
exponential law, we have: <S(pi) = 1 — In a and the fit a = 1 would give us S{jp\) = 0. 

2.3 Bessel-Ornstein-Uhlenbeck processes and their invariant densities 

Let Xi, X2, X n be independent random variables with common for all, zero mean and 
variance 1, Gauss (Brownian) probability law on R: 

p(x) = -^=exp(-x 2 /2) (16) 

V Z7T 



Let us consider 

R n = {Xl + ... + X 2 n ) 1 ' 2 (17) 

Assume the Brownian motion (Wiener process) to proceed, in n independent copies. The 
radial Brownian motion ( Bessel process) is thereby induced on R + . The probability density 
of R = R n , n > 1 at time t S R + is denoted by p(r, t), r E R + . We have: 

dR = C^)dt + dW => d tP = \ Ap - V[^^p] (18) 

It is known that the point r = is never reached with the probability 1, which models a 

repulsion, [SJ. (Here, r = is the so-called entrance boundary.) 

If we impose a restoring harmonic force (proportional to a randomly taken value of the 

distance R n from the origin). 

n — 1 i n — 1 

dR = (— - R)dt + dW d t p = -Ap - V[(— - r)p] (19) 



We take po(r) with r S R + as the density of distribution of the random variable R at 
time t = 0. Then the function p(r,t), solving the F-P equation, is the density of R = R(t) 
for all t > 0. 

The n > 1 family of time homogeneous radial (Bessel) Ornstein-Uhlenbeck processes is 
driven by transition probability densities, [9]: 

p t (r', r) = p(r', 0, r, t) = 2r n_1 exp(-r 2 )- (20) 
1 (r 2 +r ,2 )exp(-2t) 1 , 2rVexp(-t) 



l-exp(-2t) L l-exp(-2i) J L Ly n v l-exp(-2i) 
where a = and I a (z) is a modified Bessel function of order a: 

We recall special values of the Euler gamma function: T(n + 1) = n! and T(n + 1/2) = 
(2n)\^/n\2 2n . 

Straightforwardly, one can verify that asymptotic densities of the Bessel-OU process have 
the form: 

P * (r) = rt^ r "~ lexp( " r2) (22) 

A complementary check amounts to observing that the forward drift b(r) of the stationary 
B-OU process needs to obey dtp* = (1/2) Ap* — V(bp*) = 0. The invariant (asymptotic) 
density reads: 

p*(r) = iexp(-V) (23) 
with the normalization Z = J R+ exp(— V)dr. We have 

V = V(r) = ^[r 2 - (n - l)lnr] (24) 

and 

1 71—1 

b( r ) = ~Vlnp*(r) = -W = r. (25) 

2 2r 

After normalizing the mean, (R) = 1, and replacing r by s we readily arrive at the previous 
RMT spacing formulas. 

The Shannon entropy of the continuous probability distribution ( B-OU family) Eq. (|22p 
reads, [3]: 

\ , ^ fn\ n — 1 , /n\ n — 1 

*C*) = kr(-)-— ^(-)+ — (26) 

where for half- integer values, the digamma function -0 equals: 



1 n 2 

^( n + _ ) = _ 7 _21n2 + ^^- T . (27) 

fc=i 

For the Gaussian on R + , i. e. p*(r) = (2/^/tF) exp(— r 2 ), we have S(p*) = (l/2)hi7r. It is 
useful to reproduce the general Shannon entropy formula for the Gaussian on R + : 

p(r) = [2/tkj 2 } 1 / 2 exp[-r 2 /2cr 2 )] S(p) = (l/2)[ln(a 2 7r/2) + 1] • (28) 
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2.4 Calogero model 

For general stationary diffusion processes, a formula relating forward drifts b(x) of the stochas- 
tic process with potentials V(x) of an auxiliary conservative Hamiltonian system reads, [U[8] 
(we choose a diffusion coefficient to be equal |, hence scale away h and m): 

V(x)= l -{b 2 + V-b). (29) 



Upon substituting 

with = n — 1 we arrive at: 



b(x) = ^--x (30) 



V(x) = i[^^+x 2 ]-^(/3 + l) (31) 

This potential function enters a standard definition of the one particle Hamiltonian operator 
(no physical parameters): 

H = -±A + V(x) (32) 

where A = The energy operator H, with the previously introduced V(x), is an equiv- 
alent form of a two-particle (actually two-interacting-levels) version of the Calogero-Moser 
Hamiltonian, [D (H [7] . 

The classic Calogero-type problem is defined by 

1 d 2 1 , p(3 - 2) 

with the well known spectral solution: 

E k ((3) = 2k + l + ^[l + P(P-2)] 1 / 2 (34) 

where k > and (3 > —1. By substituting (3 = 1, 2, 3, 4 we easily check that Eq((3) = + 1). 

All previously considered n = 2, 3, 4, 5 radial diffusion processes correspond to Calogero- 
Moser potentials and thence Calogero operators in the (renormalized) form H — Eq where 
Eq is the respective (fix n) ground state (k=0) eigenvalue. These stochastic processes arise 
as the so-called ground state processes associated with the Calogero Hamiltonians. (Note: 
we are aware of all the "fictitious time" Dyson's model philosophy): if -0o is the ground state 
wave function, we regard = \ipo\ 2 as an invariant probability density of the stochastic 
B-OU process. Let us recall that the classic Ornstein - Uhlenbeck process can be regarded 
as the ground state process of the harmonic oscillator Hamiltonian operator. 

2.5 General comments on the quantum Calogero system 

The Calogero singular quantum mechanical Hamiltonian 

H = -^- + x 2 + ^ (35) 
ax z x z 
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has the eigenvalues 



E n = An + 2 + (1 + 4 7 ) 



1/2 



where n > and 7 > — -r. The eigenfunctions have the form: 



/n ( X )= X (^+l)/2 exp( _^_ )L « (x 2 ) 




(36) 



The 7 parameter range —1/4 < 7 < 3/4 involves some mathematical subtleties concerning the 
singularity at 0, which is not sufficiently severe to enforce the Dirichlet boundary condition. 

In the range 7 > 3/4 we deal with a double degeneracy of the ground state and of the 
eigenspace of the self-adjoint operator H. The singularity at x = completely decouples 
(—oo,0) from (0, +00) so that L 2 (— 00, 0) and L 2 (0, +00) are the invariant subspaces for the 
unitary Schrodinger evolution exp(-iHt) generated by H. The related Schrodinger prob- 
ability current vanishes at x = for all times and there is no dynamically implemented 
communication between those two areas, c.f. [16J. The respective localization probabilities, 
to find a particle on a positive or negative semi-axis, are constants of motion. Because of the 
singularity at 0, once trapped, a particle is confined in one particular enclosure only and 
then cannot be detected in another. 

The (positive semi-axis) projection operator P + defined by (P + f)(x) = XR+( x )f( x ) com- 
mutes with H. It is thus tempting and (with suitable precautions) legitimate to confine the 
discussion to R + (or R~) separately. However, we can not tell here about two disjoint 
quantum problems defined respectively on R + and R~ . We deal with a single quantum 
mechanical system, though technically - with a degenerate ground state. 

Let us also point out that D{H) contains functions restricted to obey /(0) = = /'(0) 
and not necessarily to vanish on any of half-lines. Such functions may have support on 
both, positive and negative semi-axes simultaneously, excluding the origin 0. For example, 
a normalized linear combination (standard superposition) of the two components of the 
degenerate ground state of H, is a legitimate element of D(H). There is no mixture in here. 
Are they very special Schrodinger cat states ? - good lurking-place for the cat-metaphysics ? 

2.6 Dyson's asymptotic equilibrium 

Let M be a Hermitian nxn matrix with an orthogonal, unitary or symplectic invariance built- 
in. Then, the number of independent matrix elements equals, respectively N = n-\-\n(n— 1)/3, 
P = 1,2,4. We introduce a Gaussian matrix ensemble: independent matrix elements are 
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interpreted as independent Gaussian random variables with zero mean and variance, [lUj : 

„2 



Var(M ij ) = —(l + S ij ). 

The probability density reads 

P*(Mi,....,Miv) = c -exp[-/3Tr(MM*)/2a 2 ]. 
The Gaussian RM joint density of (real) eigenvalues has the form 

A*(x,i ,X2,...x n ) = C ■ [JJl^i - Xjf] exp[-/?(y^xf)/2a 2 



(37) 



(38) 



(39) 



i<j 



Cexp[-/?(-^ln 

i<j 

i. e. (c.f. Eqs. (23) and (24)) 

1 



A ^-exp[-/?y] 



V = V(x 1 ,x 2 , ...,x n ) 



i<j 



X 2 



2a 2 



(40) 



The above observations can be inferred by passing to suitable reduced densities, in the asymp- 
totic limit of the Smoluchowski diffusion equation for the time-dependent probability density 
P{M 1 ,M 2 ,...,M N ,t): 



E 



M=Mi. 



(1 + %) d 2 



1 d 



(M -P) 



(41) 



pv dM 2 a 2 dM 

Let us fix an initial t = condition to be M', v is an auxiliary "friction" coefficient. We 
deal with independent Ornstein-Uhlenbeck processes for random matrix elements 

Tr(M - qM') 2 ' 



P(M,t)=c-[l-q'} 



2]-N/2 



exp 



-0- 



2a 2 (l-q 2 ) 



P*(M) 



(42) 



q = exp[— t/a 2 u\ 

which, in turn turn, induces the corresponding interacting Brownian motions for the eigen- 
values. P* and A* stand for invariant asymptotic (unique stationary, equilibrium) densities 
of these processes. 

Notice that choosing a 2 = j3n, we can write down a corresponding set of stochastic differ- 
ential equations (infinitesimal increments) for the interacting Brownian motions associated 
with teh n x n random matrix. Forward drifts read bj(X,t) == —Vj(/3V) and thence: 



d\j(t) 



2n 3 2 f-r Xj(t) - Ai(t) 



dt + dWj(t) 



(43) 



Their properties were studied in detail in the mathematical literature and despite the Coulomb 
(or centrifugal) singularity, the solution is known to be unique and non-explosive for all times 
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and all n, including the n — > oo limit. The eigenvalues never cross and an initially given 
(time to) order Ai < A2 < ••• < A n of (real) eigenvalues is kept forever in the course of the 
diffusion process, [TT] . 

For clarity of discussion, let us illustrate a passage from P* to spacing distributions P(s) 
for 2x2 random matrices. Namely, given the n = 2 form of Eq. (24) 



P(Mi, ...,M N ) = c ■ exp 

and 



4(A? + A|) 



(44) 
(45) 



A*(Ai, A 2 ) = C ■ |Ai — A2I • exp 
yield the spacing distribution reduced density: 

P(s) = const I dXi I d\ 2 5(s-\\ 2 - ■A*(\ 1 ,\ 2 ). (46) 



which upon securing the normalization of P(s) on R + and (s) = 1, gives rise to the generic 
RMT-spacing densities. 

3 Extremum principles: what can we say about the degree of 
randomization ? 

3.1 Min/max information entropy principle in the RMT 

The information-theory route, according to R. Balian, |12l [2]. begins as follow. We consider 
a constrained extremum for a functional of a convex function: 

1 = J ' dfi(M)P(M) -lnP(M) (47) 

with constraints j dfi(M)P(M) = 1 and 

(Tr(MM*)} = J dfi(M)Tr(MM*)P(M) = Na 2 (48) 

Next, one passes to an extended information functional with Lagrange multipliers b, d 

I(b,d) = J dn(M)[P(M)lnP(M)+bP(M)+d-Tr(MM*)P(M)] (49) 

and looks for an extremum of / (actually for a minimum information measure, c.f. 
convexity property), under the imposed constraints. The outcome is: 

P*(M) =exp[-(l + 6 + d-Tr(MM*))] (50) 

with d = and exp[— (1 + a)] = c = {-%^i) N ^ Z '■ We have thus arrived at the invariant 
(Gaussian) probability measure P*(M) for the Gaussian matrix ensemble, c.f. also [T| ll3t [T 

US]. 
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3.2 Maximum randomness issue: constrained extremum 

To have a better insight into the extremum principles at work, let us recall the standard max- 
imum (information/Shannon) entropy principle: consider [a, b] £ R, assume that everything 
you know about the a priori unknown probability measure are (possibly) its moments 

-6 

x k p(x)dx = rrik (51) 



a 



with k = 0, 1, ...,M and mo = 1-the normalization condition. 

We look for densities that maximize the Shannon entropy of a continuous probability 
distribution (now we encounter a functional of a concave function): 

cb 



s 



[p]= - [ plnpdx (52) 

J a 



under the constraint of M fixed moments, [17\ I18j. 
The extremum of a functional 

r b M r b 

S = — I p In pdx + Afc ( / x k pdx — mp.) (53) 

J a q J a 

(a concavity property of S needs to be rememebered) sets the functional form of p which 
maximizes the entropy: 

b 

p* (x) = C exp[- ^kx k ] (54) 

a 

where C = exp(— Ao — 1) is the normalization constant and A^'s are fixed by identities 

rb b 

/ x fc exp[-^ \ k x k ]dx = m k (55) 

If there is a unique solution in terms of Ai, \m, we say that that an entropy maximizing 
(under the "circumstances") density does exist. 

For reference, let us reproduce some pieces of a standard wisdom: 

(i) If a and b are finite, there exists a unique maximum entropy density; 

(ii) In R + e.g. [0, +oo) a maximizing density exists if < m,2 < 2m\. 

Notes: if there is no constraint there is no maximizing density; if only the mean m\ = 1/a 
is given, we get the exponential one: p*(x) = ceexp(— ax); for the Gaussian on R + , like e.g. 
p(r) = (2/y/ir) exp(— r 2 ) , we have S(p) = (l/2)(ln-7r + l) which is a maximum of the Shannon 
entropy under the moment constraints mi = (r) = and m,2 = (r 2 ) = 1/2; for another 

Gaussian on R + , Po{s) = (2/V) exp(— s 2 /ir), we have mi = (s) = 1, mi = ((s — (s)) 2 ) = 
(tt - 2)/2 and S{p) = (l/2)[ln(vr 2 /4) + 1]. 

(iii) In R, with no moment prescribed, or given the mean only, there is no maximum entropy 
density. 

Notes: if mi and 7712 are given, the maximum entropy distribution is the normal (Gaussian) 
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one, with variance a 2 = — m 2 i. e. p{x) 



1 



exp[— (x — mi) 2 /2a 2 ] and the Shannon 



entropy value is S(p) = (1/2) ln(2irea 2 ) . That is to be compared with the previous outcome, 
Eq. (28), for the Gaussian on R + . 

3.3 Extremum principles: statement of purpose 

Our RMT/Bessel-OU (spacing) distributions fall into the above category (ii) where an ab- 
solute (least constrained) entropy maximum on R + is set by the exponential density. With 
quite a variety of probability densities on R + in hands, can we quantify their "randomness 
level" |19] absolutely, or relative to any of reference densities ? 

Possible indications towards this end read as follows: 
(*) compare absolute values of the respective Shannon entropies for densities on R + (Cover- 
Thomas differential entropy tables); 

(**) invoke Kullback-Leibler relative entropies and look for a minimum of the relative en- 
tropy; relative with respect to the chosen reference density; 

(***) look for min/max principles (like e.g. Helmholtz free energy properties) that govern 
the time evolution of standard diffusion-type processes (it is immaterial whether the time 
label is real or "fictitious"); 

(****) investigate the "organization level" of ground state densities of relevant quantum sys- 
tems in comparison to all possible eigenstate-related probability densities. What about their 
"randomization" behavior with the growth of energy eigenvalues ? 

In fact, before we have established direct comparison tools, e.g. Shannon entropy values 
for the Poissonian and generalized Gaussian (B-OU, with a polynomial repulsion factor) 
densities, c.f. Eqs.(15), (26) and (28). Hence the above point (*) has received due attention. 

3.4 Kullback relative entropy route 

Concerning the point (**), let us define the relative entropy for densities on R + : 



with the a priori prescribed p re f. 

Let us investigate [4j a minimum of the Kullback entropy I{p : p re f) under the constraint 
imposed with the aid of an auxiliary function T(x): 



A conditional extremum (minimum, in view of the convexity property) of a functional 




(56) 




(57) 




(58) 



is reached at p — > p*, with the constraint J T{x)p*{x)dx = 9 = const: 



p m {x) = C Prefix) exp[-AT(x)] 



(59) 
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We need an overall normalization of p* on R + . It is thus useful to demand that we have 
fixed an integral: 

= J Prefix) exp[-XT(x)]dx (60) 

Our guess: choose p re f{x) and T(x), next adjust the values of 6 and C(A) to fit either of 
A = 1,2,3.... 
Explicit examples are: 

(i) Exponential family ( semi-Poisson case)on R + : 

p re f = aexp(— ax) (61) 
T(x) = — Inx 

(ii) Gaussian family ( Wigner surmise) on R + : 

Pref = (l/v^)exp(-x 2 ) (62) 
T(x) = — Inx 

The only delicate computational issue is the constraint Eq. (57), where logarithmic inte- 
grations are to be carried out. The pertinent (reference) integrals read: 

f°° 1 

/ exp(— ax) Inx dx = (7 + In a), (63) 

Jo « 



and 

'0 

where 7 is the Euler-Mascheroni constant, a > 



f 

Jo 



exp(— ax 2 ) Inxdx = — ( ) [7 + ln(4a)l (64) 

\16a/ 



3.5 Thermo dynamical extremum principles in Smoluchowski processes 

Now we can pass to the point (***) and discuss the role of the Helmholtz extremum principle 
which often takes the role of more familiar min/max entropy principle in random motion, c.f. 
[6j[20l[21]. Given a probability density p(x,t) solving the Fokker-Planck equation 

d t p = DAp - V • (bp) . (65) 

We introduce u = Dlnp and v = b — u which obeys dtp = —V(pv). 
The Shannon entropy of p 

S(t) = - (In p) (66) 

typically is not a conserved quantity. We impose boundary restrictions that p, vp, bp vanish 
at spatial infinities or other integration interval borders. We consider: 

DS = (v 2 ) -(&•«). (67) 
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We may pass to time-independent drift fields and set b = ^j, j = vp, f = — VV plus 
D = k B T/m(3. Then: 

•S = Si n t + S ex t (68) 

where 

k B TSint = mP(v 2 ) > (69) 
stands for the entropy production rate, while 



k B TS ext = Q 



J f-jdx = -m(3 (b ■ v) (70) 



(as long as negative which is not a must) may be interpreted as the heat dissipation rate: 
that in view of Q = — j f • j dx. 

Notice that because of TS = ksTS we do have 

TS int = TS-Q>0^TS>Q. (71) 

In view of j = pv = ^[f - k B TV In p] = -^V* i.e. v = -(l/m/3)V* and / = -W, we 
can introduce 

* = V + k B T\np (72) 
whose mean value stands for the Helmholtz free energy of the random motion 

F = (*) = U -TS . (73) 

Here S = k B S and an internal energy is U = (V). Since we assume p and pVv to vanish at 
the integration volume boundaries, we get 

F = Q - TS = -(m(3) (v 2 ) = -k B TS mt < . (74) 

Clearly, F decreases as a function of time towards its minimum, or remains constant. 

Let us consider the stationary regime 5 = associated with an invariant density p*. 
Then, 

b = u = DV In p* 

and 

- (l/k B T)VV = V In p, => p* = 1 exp[-V/k B T] . (75) 

Hence 

= V + k B T\np* => = -fe B TlnZ = F* (76) 

with Z = j exp(—V/k B T)dx. F* stands for a minimum of the Helmholtz free energy F. 
Because of 

Z = exp(-Fjk B T) (77) 
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we have 

p* = exp[(F, - V)/k B T] (78) 

Therefore, the conditional Kullback-Leibler entropy, of the density p relative to an equi- 
librium density acquires the form 

k B TH c = -k B T [ plnAdx = F* - F . (79) 
J P* 

In view of the concavity property of the function f{w) = -uilnw, fi c takes only negative 
values, with a maximum at 0. We have F* < F and k B TH. c = —F > 0. 7i c is bound to grow 
monotonically towards 0, while F drops down to its minimum F* which is reached for p* of 
Eqs. (76) and (77). 

3.6 Shannon entropy in quantum systems 

Presently, we pass to the point (****) raised before in section 3.3. For probability distribu- 
tions p{x) on R, with any finite mean value, whose variance is fixed at a the prescribed value 
a 2 , we have S(p) < \ ln(27recr 2 ). S(p) becomes maximized if and only if p is a Gaussian with 
that variance. 

Given an L 2 (i?)-normalized function ip(x), (J-ip)(p) is its Fourier transform. The cor- 
responding probability densities: p(x) = \i/)(x)\ 2 and p{p) = {(^^(p)] 2 give rise to position 
and momentum information (differential, e.g. Shannon) entropies: 



S(p) = S q = -(lnp) = -J p(x)lnp(x)dx (80) 

S(p) = S p = -(Inp) = - J p{jp)\np{p)dp 

For the sake of clarity, we use dimensionless quantities, although there exists a consistent 
procedure for handling dimensional quantities in the Shannon entropy definition, c.f. Eq.(8), 
[6j [21]. We assume both entropies to take finite values to yield an entropic uncertainty 
relation, [22|[23]: 

S q + S p > (1 + lnvr). (81) 

If we define the squared standard deviation value for an observable A in a pure state ip 
as (AA) 2 = (ip, [A — (A}] 2 t/j) with (A) = (ip,Aip), then for the position X and momentum P 
operators we have (H = 1): 

AX • AP > -L exp[5(p) + S(p)] > \ (82) 
z7re I 

After the Fourier transformation, taking into account the entropic uncertainty relation we 
have (<7 2 stands for the variance) 

4<t 2 > 2(evr)~ 1 exp[-2(lnp)] > (2evr) exp[2(lnp)] > a' 2 (83) 
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For the momentum operator P that is conjugate to the position operator X in the adopted 
dimensional convention h = 1. Setting P = —id/dx and presuming that all averages are finite, 
we get: [(P 2 ) — (P) 2 ] = (AP) 2 = a 2 . The standard indeterminacy relationship a • a > (1/2) 
follows. In the stationary state (P) = 0. 

There is a subtlety to be mentioned, if we wish to extend the above reasoning to Calogero- 
type models, |16j . We have effectively considered them in L 2 (R + ) instead of L 2 (R), to 
establish links with RMT-spacing distributions. Such restriction of the degenerate quantum 
model to its non-degenerate projection on R + is not an innocent step in the fully-hedged 
quantum formalism. For example, there is no standard momentum observable (self-adjoint 
operator of the form —ihd x ) on L 2 (R + ) alone. 

A discussion of this issue can be found in Ref. [16]. We point out that the degeneracy- 
induced R = R~($)R + decomposition of L 2 (R) into L 2 (R~) L 2 (R + ), for the Calogero 
quantum system, makes legitimate the usage of the standard momentum observable. To this 
end, the sufficient and necessary condition is that the Hamiltonian H decomposes as well 
H = H- (J) H+ where H_ and H + are self-adjoint on their domains in L 2 (R~) and L 2 (R + ) 
respectively. We have here fulfilled the conditions for a permanent dynamical confinement on 
L 2 (R + , as secured by set in coexistence with the standard L 2 (R) momentum observable. 

Another possible suggestion is to accept that a momentum-type operator needs not to 
be self-adjoint but merely symmetric. The uncertainty relations are known to hold true in 
this case (by the way there are many mathematical references to closely related issue of the 
time- frequency indeterminacy) . 

The Shannon entropy in the position space, and the so-called Leipnik entropy which 
coincides with the sum S q + S p , were investigated numerically for excited states of various 
quantum systems, |24]-|26|. The typical observation is that the entropy values, evaluated for 
the ground state probability densities, are minimal. An explicit check has never been made 
for the Calogero system, but we expect this generic pattern of behavior to be respected. 
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